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AN ELEMENTARY EXPOSITION OF THE THEORY OF 
FINITE DIFFERENCES.* 



By SAUL EESTBEN. 



si. 

In the Differential Calculus we study the limit of theratio[/(a:+ a#)— /(#)] 
-*-A« as A» approaches 0; in the Calculus of Finite Differences however we 
study it as a ratio in which A* is finite. 

The function of x under consideration being u, it is customary to write it 

u p and to designate its increment by a u a where a u x —u x ±^ x - «*• In the Differ- 

du 
ential Calculus -=— is not a fraction but a symbol of operation, du, dx having 

no meanings by themselves. In the Calculus of Finite Differences on the other 

hand — - is a true fraction. 

AX 

Instead of considering — *, the following simplification is ordinarily in- 

A X 

troduced. Letting Ax—h and writing x~ht it follows at once that for ^con- 
stant, Ax-—hAt, whence A t— 1. Thus it is seen that by a simple transformation 
of the real variable x, the increment may be taken as unity ; replacing t by x, 
A#-— 1 and the attention need now be directed merely to the operation A , defined 
by the equation AM 4 .=« ie+1 - w x . The above simplification consists at bottom of 
selecting the finite increment A x as the unit of measure. 

§2. 
Since A u x is itself a function of x its increment a ( A u x ) may be found 
by the same process as above ; it is ordinarily designated by A i u x . In a like 

manner the differences A i u x , a 3 u x , may be found. As an example of this 

notion of successive differences consider. the very simple function « x =a; 8 . Evi- 
dently Au x =u x + 1 ~u x —2x-t-l; A i u x =2. The following table may therefore be 
made: 



value of x 


1 


2 


3 


4 


5 


u x 

AM X 
A 2 H X 


1 

3 
2 


4 
5 
2 


9 

7 
2 


16 
19 


25 



It is interesting to observe that if any term be subtracted from the one immed- 
iately following to the right, the difference will be the term immediately below 
it. This is general of course, being due to the fact that A u x =u x+ i—u x . 
It will now be shown that if u x -=ax n , a n u x =an ! 

By definition, A«»=a(a;-(-l) n — ax*— aa: n - 1 +&,(E n - 2 +& g a: n - s + , i it i it 

—i- — . — — — — — • — ■ — — <» ■ "* — . . ' — - — ■ — ■ ■ ' — ' ■ — 

•Literature: ATreatise on the Calculus of Finite Differences, by George Boole; Theorie der Differ- 
enzen und Summen, by O. Schloemilch; Dlfferenzenrechnung, by A. A. Markoff; Dlfferenzenrecbnung, 
by D . Seliwanoff in the Encyklopaedia der Mathematischen Wiesenschaften, Bd. 1, Heft 6. 
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, being constants; repeating the process the result may be written 

A 2 Ma;=am(« — l)aJ n - 2 +c 1 a ,n - s +c 8 a? , - 4 4- , c u c 2 , being constants; 

continuing in this manner the desired result is reached. 
Evidently A r aa?=0 if r>s, hence 

A n (a 1 x»+a i x n - 1 + +a„^ 1 x+a n )—a i n\ 

An expression 

x(x— l)(x— 2) (a;— w»+l) =«( m > 

is known as a factorial. It is important to observe that in the Calculus of Finite 

Differences factorials play an analogous rdle to that of powers of x in the Differential 

Calculus. 

dx m 
Thus, — 5— =mx m ~ 1 ; now A#( m) =(a:-|-l)( m > — ar< m > 

=(x-\-\)x(x— 1) (x—m-\- 2)— x(x—V) (x— m+l)=mx( m - 1 '> . 

The following theorem of the Calculus of Finite Differences reminds one 
of Maclaurin' s theorem in Differential Calculus : Let <£(#) he a rational integral 
function of x of the mth degree, then it may be expanded in a series of factorials 
thus: 

(1) «,H(0) + A(0).f^> + ^.+ ... +^P*™- 

In proof, assume 

$(x) =a+bx+cxf?> + dxW+ .+ Az (m >, 

then a $(x) =5 + 2cx+3dxM -\- + mhx (m - l \ 

A *<l>(x)='2c+3.2dx+ -\-m(m-l)hx( m -v, 

A m <f>(x)=m{m — 1) 2.1. h. 

From this it is clear that 

«=«<», ft=A«0) f 0=^>, , »=^. 



In §6 difference equations will be studied of the general form 

(2) <p x (x, u x , u x+u , u x+n )—0. 

The considerations of §§1, 2 would, lead one to suppose however that a linear dif- 
ference equation should have the form 
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(3) (Piix, AU X , A*!*,, , A»W*)=0 

where A 2 m*=a ( am*), a*u x =a(a' 2 u x ), 

The equations (2) and (3) are in reality equivalent. First, by demon- 
strating that for any integer j the difference &-'u x can be expressed linearly with 

constant coefficients in terms of u x+ j, h x+ j-i, , u x+i , u x it will be concluded 

that an equation of the form (3) may be replaced by one of the form (2) ; sec- 
ondly, by showing that u x+ j can be expressed linearly with constant coefficients 

in terms of a iu x , a s—1 u x , , AUx, u x it will be concluded that an equation of 

the form (2) can be replaced by one of the form (3). 

I. By definition au x =u x+ \— u x , whence 

A 2 u x =a(au x )=(u x+2 -u x+1 )-(u x+1 -u x )=u x+2 -2u x+1 +u x . 
By the ordinary method of induction it may be seen that 

j( }_l) 

(4) Aiu x =u x+j - ju x+j -. 1 + J ™ 2 ' u x+J - 2 + +( -iy«*. 

II. From A u x =u x+ i— u x it is seen that u x+ i—u x -{- au x , whence 

u x+2 —u x + A U x + A (u x + A U x )=U x +2 A U x -\- A i u x . 
It follows now by induction that 

id— 1) 

(5) U X+J =U X +J A «s+ J v £ 2 A 2 U x + + A'U X . 

§4. Applications. 
I. "Writing for x and x for j in equation (5) there results 

(5') it x =u +xAu -\ — 2 i A 2m o + 

Suppose now there is given log3.14=.4969296, log3.15=.4983106, log3.16 
=.4996871, log3. 17=. 5010593; required an approximate value of log3. 14159. 

The following table with the decimal point omitted may be written down 
at once : 

tt« Mi ti~ M. 





4969296 


4983106 


4996871 


A 


13810 


13765 


13722 


A 4 


-45 


-43 




A 3 


2. 







5010593 



The common difference of 3.14, 3.15, 3.16, 3.17 is .01; this being taken 
as the unit gives the value of x which corresponds to 3.14159 as .159. Hence 
by (5'), 
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(6) M;i; =4969296+.159xl3810 + K.159)(.159_l)x(-45) 

+K-159)(. 159-1)(. 159-2) X2j 

whence m^=.4971495, which is correct to the seventh decimal place. 

II. In Life Insurance it is customary to denote the number of men living 
at an age x by l x . Suppose there is given a Mortality Table, obtained from stat- 
istics, containing the values of I for intervals of Ave years ; the problem is to in- 
terpolate for the intermediary values. The formula (5') is applied. 

Let u x be the desired value of the number living at the age x, l x±z —l' z the 
number living at the nearest five-year period which is s years younger or older 
than the age at which the value is desired. Evidently 2>2. 

If M =r 2 _6, Ui=l' z , u. 2 —l' z+B , u x =l x , it is seen that 

a» =!',-^i AWj^'s+5— V„ and 

A ! Mo=(Z'*+6-Z'*)-(Z'*-Z'*-«)=Z'*+5-2Z' 2 4 l' s _ h . 

Inserting in (5') and stopping at the second differences, 

(7) t=r._,+«(r,-r._ B )+^^(r.^-2r,+r^). 

It should be kept in mind that in (7) z is expressed in units of one year while x 
is expressed in units of five years. 

III. The area bounded by a curve, two ordinates u , u 2 and the axis of x 
being divided into two equal parts by the ordinate m, , an approximate value for 
the area is required, the distance between n and u x being taken as the unit of 
length. 

The general ordinate being u x , the expression for the required area 

/Uxdx becomes, by means of (5'), 
n 



/2 sv f x A 2 « /* 2 
u x dx=u J dx+ au J xdx-{ ^ I x(x— 1)&:=2w + 2aw -)-&a 8 m . 

Since Au =u 1 — u , A *u —u 2 —2u l +u , it follows that 

i 
ujlx- 



J o 



2 „ a VtVK 



This is known in the Calculus as Simpson's Rule, the generalization of which 
for the numeral solution of differential equations was made by Professor 
C. Runge in the Mathematische Annalen, volume 46. 

Consider the interval u u e divided into six parts by the seven equidistant 

ordinates u , M lf u 2 , ,u e , the distance between the two adjacent ordinates 

being taken as the unit of length. The formula for the area becomes by (5') : 

f uxdx=6u +18 A w +27a s m +24 a 3 m +J# a 4 « +||a ^o+xVtr a 6 «,. 
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The last coefficient, ^ s , differs from -^ or ^ by the small fraction -j^, 
and as from the nature of the approximation the sixth differences are supposed 
to be small, the error will be' very slight if the last term be changed to -fo a 6 m . 
By means of §2, I, it follows now that : 



f 

•J o 





This very elegant approximation for the area reads in words : Divide the area 
into six equal parts by means of. seven ordinates and take three-tenths of the sum 
of the odd ordinates plus five times the sum of the even ordinates plus the mid- 
dle ordinate ; the distance between the ordinates being the unit of length. 

The generalization of this interesting rule for the numerical "solution of 
differential equations has not yet been made as far as I am aware. 

§5. 
The term "finite integration" is employed to denote a process whose re- 
lation to a is analogous to the relation of integration to D x =—=-. 

In the Calculus integration may be defined in two ways, first as an area 
I f(x)dx and secondly as the inverse of differentiation, i. e., D x _1 /(a;), the for- 
mer being related to the latter by the equation 

u a •- -la 

The situation in the theory of finite differences is similar ; the finite integral of 
u x may be also defined in two ways. 

I. Let av x =u x , let a be some constant and take u a as the initial term, 
then v x =S a x u x *=u a -i-u a+1 + + Ux-i. 

For v x+ i=u a +u a +i+ + u x .-i-{-Uz, whence v x+ i—v x = A v x =u x . 

II. Su x =\_A- 1 u x ~\. The number of expressions satisfying this second 

definition is infinite since it includes M a +w +i + -fUx+i for all values of a. 

But just as in the Integral Calculus it may be shown that SaU x =\_&— 1 u x ]*. 

Let /(a:) be a function such that Af(x)=u x , 

/(« + l)-/(a)=w a 
/(a+2)-/(a+l)= Wo+1 

/CO-/(*-l)=w«>-i, 
hence, by addition, A x )— /(«)=#/«*> 

and from Af(x)—u x , which gives/(a;)= A —htm , it is seen that 8 a x u x =[ A ~ 1 u x ]*, 

*We regard the use of S in place of the customary 5 as preferable, first because It corresponds 
closer to the C of the Integral Calculus; secondly, because It leaves the 2 open for use In denoting 
ordinary summations; and thirdly, when the Integration cannot be performed and the S must be regarded 
as a functional symbol, there cannot be any confusion as may possibly occur in the case of the 2- 



136 

the value for the lower limit being subtracted from the value for the upper limit. 
The above makes it possible to speak of definite and indefinite finite integrals. 

III. Let S x u x =f(x) be defined according to I and let A~ 1 u x =f(x)-\-w x ; 
then u x =Af(x) +- aw x =u x -\- aiv x , whence aw x =0; that is to say, w=constant, 
and therefore A~ 1 ttx=S x n x -\-G. 

IV. In §3 it was shown that Asr< TO >=»ta;( m_1 >, where x( m> >=% f K x — \) 

(x— m +.1 ) . This gives immediately an illustration of finite integration, namely : 

/j;(nt+l) /j.(2) A S U 

#rj(m) = — 4 (;, By substituting u x =Sv x in (5'), u x =u Q +x A u -\ ^ — °+ 

and writing c=tt , there results 

(8) 8i' x —c + xv + -g-j- av + 

the number of terms being finite if v x is rational and integral. 

Suppose now that it be required to find the sum of l 2 +2 2 + -fa;'. 

Applying (8) and observing that A» =l, A "v — -2, 

1- + 2- + + ix -iy = a*=*S-t2=£+ ^"^ gzglA 

When x—2, c=0, and adding x 9 to both sides it follows by easy reductions that 

l 8 +2*+ +x*=ix(x+l)(2x+l). 

§6. 

It sometimes happens that instead of the difference a u of the function u 

being given to determine u, some relation between its successive differences is 

2 2 

given. As illustration, let A *u x -= =- A u x ... A x ; it may easily be ver- 

X T" J. X \p0~ J~"-l.) 

ified that the solution is u=ctx°' -\-bx. 

In general, if the relation/(a;, u x , c ± , , c n )=0 is given, and if c,, 

, c n are eliminated by means of the successive differences A*f(x, u x , c, , , 

c n)=fi( x > v-xi »i> j c„)=0 (t=l n), there will result a difference equation, 

F(x, u x , AUx, , A n w x ) = 0, whose complete primitive f(x, u x , e lt , c„)=0 

contains n arbitrary constants. By §2, I, the latter equation can be replaced by 
one in u x , u x+u , u x+n ; solved for u x + n it has the form 

(9) Ux+n = <!(X, U x , ll x ^i, -., t« J . +n ._,). 

It will be observed that the independent variable x takes on values which 

differ by unity, hence u x+n+l =;&(x+l, u r +i> , Ux+n) ; eliminating u x+n by 

means of (9) the result may be written u x+n+ i =4'(x, u x , , w x+m _i ). Similarly 

(10) u x+n+m —4' m {x, u x , ,u x+n -i) (j»=1, 2, 3, ). 

It is now clear that the difference equation (9) is a recursion formula for 

the function u in terms of the n arbitrary values at the points x, x+1, , 

x + « — 1. Replacing x-\-n-\-m by x the general expression for the function is ob- 
tained. It should be noticed however that it is tacitly assumed that the function 
4' is finite at the points x, x+ 1, , x+n+m. Thus, if the equation is linear 

U x+ n +#r (1 «x+n-l + "h#r (n) U x =0, 

the above discussion applies only when the coefficients p x < l >, , p x i"> are finite 

at' the points x, x + 1, x-\-2, The general linear homogeneous equation of 

the first order may be written in either of the equivalent forms A u x -\-q x u x =0, 
Ux+i— PxWx • Starting with x=a and taking successive values, 

U a+ i=p(a)ll a , U a +2=p(a + l)u a+ i, , «a+m=i>(«+»»-l)Mo+m+l, 

this gives at once u a+m =p(a).p(a+l), , p(a-\-m — l)u a . Writing a+m=x 

u a =c, we have u x =c.p(x— l).p(x— 2) ,p(a-{-l).p(a) which is the general 

solution sought. 

Just as in the theory of linear differential equations certain other special 
cases, such as equations with constant coefficients, can be integrated. For the 
linear equation of the «th order (w> 1 ) with variable coefficients no general 
methods are known. 

Chicago, June, 1904. 



